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Abstract. - We address the question of geometrical as well as energetic properties of local 
excitations in mean field Ising spin glasses. We study analytically the Random Energy Model 
and numerically a dilute mean field model, first on tree-like graphs, equivalent to a replica 
symmetric computation, and then directly on finite connectivity random lattices. In the first 
model, characterized by a discontinuous replica symmetry breaking, we found that the energy 
of finite volume excitation is infinite whereas in the dilute mean field model, described by 
a continuous replica symmetry breaking, it slowly decreases with sizes and saturates at a 
finite value, in contrast with what would be naively expected. The geometrical properties of 
these excitations are similar to those of lattice animals or branched polymers. We discuss the 
meaning of these results in terms of replica symmetry breaking and also possible relevance in 
finite dimensional systems. 



Spin glasses [1] , disordered magnets displaying many out of equilibrium phenomena such 
as aging, memory and rejuvenation are, on the theoretical level, now believed to be well 
described on fully connected and finite connectivity random graphs by the so called replica 
symmetry breaking (RSB) picture [2], sometimes referred to as the mean field scenario, in 
which the free energy landscape is divided into many valleys with 0(1) energy differences. 

For finite dimensional spin glasses, most particularly for the Edwards- Anderson [3] (EA) 
model, how to describe the ordered phase still remains controversial. A nice renormalization 
group picture called the droplet model [4], based on real space properties and scaling laws, 
gives many nice and useful results but it is still not clear if this picture describes well all 
properties of the EA model. It starts with the very assumption that there is only one state 
(or ground state at T = 0, and up to a global spin flip) and that the typical energy of a 
compact cluster of spins of size i (^) goes like . The energy distribution of such clusters is 
assumed to be very large, so the probability of finding a droplet of energy 0(1) goes like 
A positive 9 is then needed to have a finite Tc. Compactness and size independence (i.e. that 
a droplet of size 21 is not correlated with the one of size I) are assumed in this theory. 

There are actually many definitions of in the literature, corresponding to different types 
of clusters, and it will be of some use here to consider three types of excitations, we will thus 

(^)We define the energy of a cluster as the energy difference between the original configuration and the one 
where all spins belonging to the cluster are flipped. 
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need three exponents: (1) 9g (g for global) will describe the energy of low lying system-size 
excitations [5] those energies are assumed to scale like L^" where L'^ = N is the size of the 
system, (2) 6i (1 for local) will describe the energy of finite volume Minimal Energy Clusters 
(MEC) of n spins given that a particular spin i belong to it (i.e. for all clusters of n spins 
that contains the spin i, the MEC is the one with minimal energy); their energies scale like 
, where i is the typical linear size of such a cluster of n spins, and (3) 6, the original droplet 
exponent, will describe the energy of droplets (they are defined like MEC with the constraint 
of being compact and size independent, see [4] for a description of the droplet/scaling theory 
and effective definition of compatness and size independance) and their energy goes like 
This latest droplet exponent is usually computed via domain- wall (DW) studies [7, 8] though 
it is not straightforward that droplets and domain walls share the same energetic properties, 
i.e. that 9 = 9dw- A natural realization of this droplet picture arises in spin glasses on 
hierarchical lattices, or in the Migdal-Kadanoff renormalization group(MKRG), where one 
can compute analytically energetic properties and show that 9dw = 9 = 9i = 9g [9] i.e. that 
domain-walls, droplets, MEC, and low energy system-size excitations have the same energetic 
(a typical energy growing like i^) and geometrical (they are compact with a fractal surface 
dimension dg = d — 1) properties. 

In mean field systems however, there are several macroscopically different states so that 
it must be possible to find (at least) system-size (involving a finite fraction of spin of the 
system) excitations of 0(1) energy with a finite probability. In our notation, this many valley 
picture thus implies 9g = (it has also been suggested that these system-size objects exist in 
the EA model; they are called sponges in this context due to their topological properties and 
according to mean field predictions [5] they have 0(1) energy and a fractal surface dimension 
dg equal to the space dimension d). For finite volume excitations, i.e. for the very equivalent 
of droplets and MEC of n spins (or of typical size £) in mean field systems, the situation 
is unfortunately still rather unclear. It was first suggested that in mean field models these 
MEC should be like droplets, i.e. that they have an energy growing with their size [5] and 
the probability to find one with energy 0(1) should decrease like (with 9i = 9 > 0) so 
that only system-size excitations have low energies {9g = 0) and non trivial properties. The 
a-priori reason for such a belief comes the Bethe-Peierls argument stating that if, locally, 9 <0 
then there is no spin glass phase. We will show that an ideal realization of such a scenario 
arises in Derrida's Random Energy Model (REM) [10] in which 9g = and 9i = 9 = oo. The 
difference between mean field and scaling pictures would then lie in the value of 9g. 

It has been however noticed [6] quite recently that the energy of MEC could be different 
from droplet's and may decrease with size without jeopardizing the spin glass phase at finite T 
provided that they are not size independent, i.e. that excitations of size 2i are not independent 
of excitations of size I and are correlated enough. Hence the value of 9i (which does not assume 
independence) might be different from 9 and can a-priori even be negative; this remains an 
open question. In [6], the authors found indeed a negative, thought very close to zero, value 
of 9i in the 3d EA model; thus it would be nice to have similar results in systems which are 
known to have a finite temperature phase transition. Moreover the relevance of mean field 
results in finite dimensional systems is still very controversial and in order to understand what 
mean field has to say on this matter, we should understand what properties of local excitations 
in mean field models really are. It is also useful, for the very understanding of the mean field 
spin glass phase and of the continuous RSB phenomenon, which has been proved to be useful 
in many systems over the last few years, to investigate these properties and to construct a 
sort of droplet picture for these systems. Finally, due to a proliferation of definitions of 9s 
and numerical studies of their values, it is also useful to fix the notation and to understand 
links between them. It is the aim of this letter to fill these gaps. 
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We study in this letter two mean field Ising models: (1) the REM where we find Og = 
and 9 ~ 9i — oo, and (2) the finite connectivity Ising spin glass with Gaussian couplings in 
two different cases: (a) on a Cay ley tree with fixed random boundary conditions, a system 
equivalent to a replica symmetric (RS) approximation where finding ground states and MEC 
is easy, and (b) on random graphs (or Bethe lattice, see [11] for a precise definition), the well 
defined but harder to study, mean field model. In the REM we use simple analytical arguments 
whereas in finite connectivity models we find ground states numerically, then pick a spin at 
random and look for the cluster of n spins containing the previous one which minimizes 
the energy (the MEC); that gives a E{n) that we average over many instances. Our main 
result is that the MEC energy decreases with their size and saturates to a finite value, giving 
6l = 0g = and thus violate the Bethe-Peierls argument (note that wc defined in this work 
mean field ^s exponent hy E = •nf where n is the number of spins rather than with the linear 
size £ of the droplet. This make no changes in this study since we find either or oo). We also 
find that the geometrical properties of these excitations are those of lattice animals, which 
gives some hints to the value of the upper critical dimension d„. In conclusion, we comment 
on these results and their potential relevance in the EA model in the light of [6] . 

The Random Energy Model. - At zero temperature the REM, as defined as the p ^ oo 
limit of p-spin models [10], is a fully connected spin model where all configurations have 
random energies taken from a Gaussian distribution of mean and variance N. It has a 
ground state of energy Eq oc — A^Vhi 2 with variance of 0{1). They are also 0(1) energy 
excitations of size 0{N) leading to RSB; thus according to our definition we have 0g = 0. 
Let us consider now finite volume excitations. The number of excited clusters of n spins that 
contains a particular spin i is 0(A^"); a straightforward extremal computation (^) gives that 
the typical energy of such clusters is 0{—V nN In N) and a comparison with ground state 
energy Eq then gives that energy difference is 0{N). We thus obtain 9i = oo for finite volume 
excitations (i.e. n « N/\nN) and only system-size (with n » N/lnN spins) excitations 
have 0(1) energies and 9g =0. 

The REM is thus an exact realization of the scenario described in [5]. This has a sim- 
ple interpretation in terms of one-step RSB in which the energy landscape is dominated by 
macroscopically different valleys but whore, inside a single valley, the energy increases while 
going away from the bottom. In the REM the valley is composed by only one configuration, 
this is why 9i = oo, and a natural expectation is that, in more realistic models where there 
is a similar clustering in the energy landscape, 9i should be positive but finite. However the 
REM is described by a so-called one step RSB ansatz and the situation might be different in 
models with full-step RSB that we shall now consider. 

The spin glass on a Cayley tree. - Before considering finite connectivity mean field spin 
glasses, let us first consider the problem on a tree with fixed boundary conditions. This system 
is known not to be a very good mean field spin glass and a computation on such lattices is 
actually equivalent to a RS approximation of the result on random graphs. However, since 
numerical computations are easier on this type of graph, we will obtain a quasi-thermodynamic 
(more than 2^° spins) limit result, free from finite size A'' effects, that will turn out to be a 
useful RS approximation of the real value of MEC energies. 

A Cayley tree of connectivity k + 1 is built starting from a central site, and constructing 
a first shell of A: -|- 1 neighbors. Each of these first shell spins are then connected to k new 
neighbors in a second shell etc.. until one reaches the L'th shell which is the boundary. Thus 



(^)The typical minimum of x random values taken from a Gaussian distribution of variance N is -ViVlnx. 
The ground state is thus Bo ^ —N\/\n2 and the minimum of AT" values is E{n) « -\/Nn\aN. 
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Fig. 1 - Left: mean energy of a MEC of n spins in spin glasses on a tree and on random graphs of 
different sizes A'' for connectivity 3. Tree curve, corresponding to the RS approximation, is believed to 
be an upper bond. These curves clearly saturates at a finite value implying 6i — 0. Right: distribution 
of such energies for a MEC of 5 and 10 spins on a tree (dashed curves) and on A'' = 600 random 
graphs (full line). 



a finite fraction of spins are on the boundary, making it a very inhomogeneous system for 
which properties are dependent on boundary conditions; indeed even in an infinite system we 
can not forget them since they fix the degree of frustration. This system is known to exhibit 
a finite T spin glass transition. Finding ground states and excitations on such a tree is a 
polynomial problem. We are thus able to compute ground states up to very big sizes and 
average over many instances and thus our results are very accurate. We will focus on fc = 2 
(connectivity c = 3). The energy E{n) of the MEC of size n is found clearly to decrease and 
to saturate at large values. A fit of our data gives, with good precision, that the mean energy 
E{n) is close to E{n) ^ A + BrT^^^, A and B being positive constants. The exponent close 
to —0.66 is interesting in itself as it has already been noticed to play an important role in 
ground state energy finite size corrections [9, 12]. When a large magnetic field B is applied, 
the energy increases with size; for smaller field {B < 0.6, Be being 0.48 in this model [13]) 
we could not see this effect and we obtain data similar to those at B = 0. On fig. 2 a finite 
size scaling of energy difference AE{n) = E^{n) — E^^^{n) is plotted vs {B — Bc)y/n, using 
Be = 0.48. Data collapse is excellent (^). 

Asymptotic energy of MEC seems finite in the RSB phase, thus di = 0. Since we know that 
there is a finite temperature phase transition we conclude that mean field spin glasses violate 
the Bethe-Peierls argument. Moreover, this shows very nicely that a system of size + 1 
differs from the one of size A^ because it flips these large system-size clusters so its ground 
state changes completely from size to size. Fixing boundary conditions also prevents these 
system-size excitations from being thermally excited, which is why this problem is finally RS 
with a trivial P{q) and why, in order to have a well defined system, it is better to define a 
Bethe lattice with random graphs [11]. 



{^)AE{n) is a bit negative when B < Be; this seems to be a pathology of the Cayley tree that vanishes at 
B > Be. 
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Fig. 2 - Left: rescaled energy difference AE{n) = E^{n) — E^^^(n) versus B on TV = 400 random 
graphs with Be ~ 0.32; In inset the same plot on Cayley trees with Be = 0.48. Right: end to end 
distance scale like ^/nlnn in the spin glass phase (this plot) as well as in the paramagnetic or the 
disordered ferromagnetic phase, suggesting that these clusters are in a lattice animals phase. In inset, 
l{n) for 3 different instances, showing strong correlations among sizes. 



Spin glass on a random graph. - Spin glasses on finite connectivity random graphs are 
supposed to be described by a continuous RSB ansatz; solving their ground states is exponen- 
tially hard and now we have to use a heuristic algorithm [14]. We then search MEC of size 
n by choosing a spin at random and making an exhaustive search of all clusters and finally 
choosing the one with minimal energy. We can a priori expect E{n) to have a behavior similar 
to the RS one because RS approximation usually gives an upper bound to the full RSB behav- 
ior, in which case E{n) should not increase with n in this model. MEC energies are plotted 
on fig. 1 for connectivity 3 and seems to confirm that RS results are upper bounds. Again, 
energy decreases and seems to saturate when n — )■ oo. We also see a strong N dependence 
of E{n) that gets closer to the RS result when N increases. When we fit these curves, we 
obtain a finite asymptotic value that increases with N and an exponent going from —0.2 than 
—0.4, compatible with a value —0.66 at TV = oo. We have checked that all these results re- 
main qualitatively the same when we change some parameters like the distribution of disorder 
(Gaussian couplings or discrete ± J) or the connectivity (we find similar results for c — 4,5 or 
6, though numbers of spins (~ 10 spins) considered were smaller). Again, if a magnetic field 
is applied, we are able to reproduce the finite size scaling observed on the tree, though with a 
smaller value of which is probably due to finite TV effects (fig. 2), the Be giving the best 
scaling increasing with TV. Thus, again, 9i = seems true in the whole spin glass phase. 

These results strongly suggest a deep link between the continuous RSB and the presence 
of low energy excitations of all sizes: it seems to be because of the presence of such excitations 
that the replica symmetry has to be broken. To conclude, mean field spin glass goes against 
the Bethe-Peierls argument and energy exponents of local as well as global excitations are 

Oi = eg = 0. 

Geometrical properties of excitations. - For entropic reasons, we may expect these ex- 
citations to be in a lattice animal, or branched polymer, phase, as suggested by [6]. On a 
tree the gyration radius of such clusters is growing like ^/n [15, 16]; it is however easier, for 
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numerical reasons, to compute the average distance /(n) from the root of the cluster of n spins 
to the deepest point in the tree. In that case, since a lattice animal cluster of size n is more 
less composed by ^/n independent branches with typical size ^/n and a Bose-Einstein like dis- 
tribution [17], a simple straightforward computation of extremes gives that l{n) oc i/nlnn for 
lattice animals (^). This scaling works perfectly well (see fig. 2). Note also that lattice animals 
have a upper critical dimension (/„ = 8 which is also the dimension at which mean field spin 
glass theory break (amazingly the related branched polymer problem has d„ = 6 in ^-solvent, 
and d„ = 8 in the generic case; these two dimensions are known to be also the two where 
something happens in spin glass field theories [18]), giving more credit to the link between 
these excitations and the presence of continuous RSB. To illustrate the size dependence, l{n) 
is also plotted for 3 particular instances, showing the correlation between l{n) at different n. 

Discussion. - We have studied properties of local excitations involving a finite number of 

spins in mean field spin glasses. In the REM, a IRSB model, we found that the energies of these 
excitations are infinite, so 9i = oo. However we find something different on a Bethe lattice, a 
full RSB model, where the energy decreases and saturates to a finite value. Though it might 
rc-incrcasc at very large vahics of n, this is unnatural in such graphs where the typical size is 
unity and we do not see any sign of that; the natural interpretation is thus that 9i = and 
that there are clusters of all sizes with finite 0(1) energy. Finally, the geometrical properties 
of these excitations arc those of lattice animals (note that somehow similar statements on 
branched clusters in spin glasses was proposed in [19]) , which may justify why dimensions 6 
and 8 play such an important role in spin glasses mean field theories. 

Any minimal scenario of real space excitations for spin glasses with fiill RSB should then 
include this branch of finite size clusters, as was first proposed in [6], different from the droplet 
one, in which MEC behaves with 9i = 0. If there are also system-size (thus involving a finite 
fraction of the system) 0(1) energy excitations, they lead to non-trivial P{q). However this 
is impossible for a spin glass on a tree because fixing boundary conditions prevents large spin 
clusters to flip, this is why a spin glass on a tree gives an RS approximation of the real mean 
field system (i.e on a tree 9i = but 9g > 0). Confirming these results in other connectivities, 
for larger sizes and other RSB models, as well as investigating differences seen between one- 
step and continuous RSB, would be very useful. It would be also nice to understand more 
precisely the link between the properties of these excitations and the instability of the RS and 
successive RSB approximations within the replica method where full RSB models (in contrast 
to IRSB model) are characterized by the presence of Goldstone modes (see for instance [20]) 
suggesting, in full agreement with our work, that there are excitations of all sizes with 0(1) 
energy. 

There is finally the question of relevance of these excitations in finite d. Assuming, with [9], 

the existence of MEC with similar properties, we can expect in high dimension that they induce 
a RSB phenomenon although the way MEC turn into sponges is actually not straightforward. 
Some semi-analytic results suggest how it may happens (there are for instance many ground 
states in some modified spin glass models in d > 8 [21]), but it is not obvious to see how 
energetic and geometrical properties of MEC should be modified when they turn into space 
spanning objects and start to wraps around the periodic boundary conditions. In lower 
dimension the situation is even more matter of debates, and some effects below d = 8 might 
also induce deviations from mean field behavior. However, it may be worth noticing that (a) 
the usual droplet branch may be quite well described by the MKRG, as suggested by many 



(*)The length distribution behaves for largest length like e Vv^^ the extremal value Imax of \/n realizations 
is then given by /^°° e'^/^dl = l/^/n thus / ■max y/nhin. 
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results and equalities between a-priori unrelated exponents [9] and the fact that lower critical 
dimensions are well predicted by these approaches, (b) the mean field branch of excitations 
may also exist in these models, as argued in [6] who finds numerically some lattice-animals like 
MEC with 01 < in 3d (they seem however to have larger energies and a positive exponent 
when a magnetic field is applied, which may indicate the absence of spin glass phase in 
a magnetic field, in contrast to the present study) with a Pn{E) very similar to ours (see 
however [22] for debates on these results) and (c) there is also much numerical evidence for 
6»g w in 3rf [23]. 

* * * 
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